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Abstract 

We consider a stochastic variant of the game of Bulgarian soli- 
taire jni ■ For the stationary measure of the random Bulgarian solitaire, 
we prove that most of its mass is concentrated on (roughly) triangular 
configurations of certain type. 
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1 Introduction and results 

Consider the following (random) game: a deck of cards is divided into 
several piles. Then, for each pile, we leave it intact with probability 1 — p 
and remove one card from there with probability p {p & [0, 1] is a given 
parameter), independently of other piles. The cards that were removed are 
collected to form a new pile. The order of piles is not important and the 
piles of size zero are ignored. The case p = is trivial (nothing moves) and 
will not be considered. When p = 1, this is the game of Bulgarian solitaire, 
made known by Martin Gardner in P , and studied in [TJ El HDl HH 112] (cf ■ 
also 13 E] ioT some variations of that game). The "truly random" model 
with parameter < p < 1 is a discrete-time irreducible and aperiodic Markov 
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chain on the space of all unordered partitions of A^; for obvious reasons, it 
will be referred to as the random Bulgarian solitaire. 

If the number of cards is a triangular number, i.e., A^ = 1 + 2 + ■ ■ ■ + k 
for some k, a remarkable fact is that, starting from any initial configuration, 
after a finite number of moves the (deterministic) Bulgarian solitaire will 
reach the stable configuration formed by piles of sizes k, k — 1, . . . ,1. The 
above result was proved in (see the solution to Problem 6.10) and in j3] 
independently, and later it was discovered that the maximal number of moves 
necessary to enter the stable configuration is k"^ — k, and that that bound 
is sharp (see [TTl [121 )• ^ ^ triangular number, then such a stable 

configuration does not exist. However, it is possible to prove that after at 
most 0{k'^) = 0{N) moves the game will enter into a cycle. Moreover, all 
the configurations of the cycle are "almost triangular" in the following sense. 
Let k = max{n : 1 + 2 + ■ ■ ■ + n < A^}; then all the configurations in that 
cycle can be constructed from the configuration [k, k — 1, . . . ,1) by adding 
at most one card to each pile, and maybe adding one more pile of size 1, see 
[H El Uni mi for exact formulations and more details. 

Thus, we see that Bulgarian solitaire "likes" triangular configurations, 
and so we may expect some kind of similar behaviour from the random 
Bulgarian solitaire. There is no possibility, however, to obtain exact results of 
the form of those of the previous paragraph, since random Bulgarian solitaire 
is a finite irreducible Markov chain, so it visits all its states infinitely many 
times a.s. Instead, we aim at the results of the following kind: the stationary 
measure of the set of configurations which are in some sense close to the 
(rescaled) triangular configuration is close to 1. This can be regarded as a 
"shape theorem" result even though it is substantially different from most 
of the shape results appearing in the literature. (In most cases some time- 
dependent random set is constructed, and then, when rescaled by time, it 
converges to some, usually nonrandom, shape. See e.g. [21 El 1131 EE] for results 
of this kind.) The results we are aiming at resemble rather those of [HllZl. 

Also, let us remark here that the question of how fast the deterministic 
Bulgarian solitaire approximates the triangle has not been yet studied in the 
literature. To motivate this question, take A^ = l + 2 + - — \- k, and suppose 
that the initial configuration is (A; — 1, — 1, /c — 2, /c — 3, . . . , 3, 2, 1, 1), i.e., 
the exact triangular configuration is modified by removing one card from 
the biggest pile and forming one more pile of size 1 with that card. Then, 
macroscopically this configuration is already quite triangular; however, if we 
are aiming to reach {k,k — 1, . . . ,1), this is the worst possible initial configu- 
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ration (the number of moves needed is exactly k"^ — k, cf. fl])! Here we prove 
that, whenever the initial configuration is "reasonable" (i.e., the number of 
piles is 0(A^^/^) and the number of cards in the biggest pile is also 0(iV^/^)), 
we need only 0{N^^'^) moves of deterministic Bulgarian solitaire to make the 
(A^^/^-rescaled) configuration close to the triangle. While such a result by 
itself may not be of great interest, the method of its proof will be an impor- 
tant tool in the course of the proof of the results about random Bulgarian 
solitaire. 

Now, we introduce some notations and give the formal definition of the 
process. If i{S) is the number of piles in the configuration S, we write 
S = {ki, . . . , ki(^s)), where ki > . . . > ki(^s)- We denote also by R{S) := ki the 
size of the biggest pile and by jS"! := ki + - ■ ■ + ki(^s) the number of cards in the 
configuration. Let ord(?T,i, . . . , rim) be the operation of putting ni, . . . , in 
the decreasing order and discarding zeros. Now, let .^i, ^2, ^3, ... be a sequence 
of i.i.d. random variables such that P[.^i = 1] = 1 — P[^i = 0] = p. Then 
the operator Qp which transforms the configuration S* = (fci, . . . , A;£(5)) in the 
game of random Bulgarian solitaire with parameter p is defined by 

QpS = ord(A;i - ^1, . . . , h^s) - 6(5), ^1 H \- it{S))- 

Denote also by Q^^S the result of n independent applications of Qp to 5"; 
clearly, the process is conservative in the sense that |Qp"''5'| = 151 for all n. 
Suppose that l^ol = A^. As remarked above, for < p < 1 the stochastic 
process So,QpSo,Qp So, ■ ■ ■ is an irreducible aperiodic Markov chain with 
finite state space Xn '■= {S : \S\ = N}. We denote by vrp^Ar(-) its stationary 
measure. 

To formulate our results, we need also to find a way to define sets of 
configurations that are close to a specific triangular configuration. To this 
end, for two configurations 5*1 = (ni, . . . , ne(^Si)), ^2 = ('^i, • • • , fne{S2)) define 
the distance p{Si, S2) by 

p{Si, S2) = max \nj — mA, 

with the convention rij = for all j > i{Si) and rrij = for all j > £{82) ■ 
Next, we define the triangular configuration T(p, N) = {rii, . . . , rim^) by rij = 
\{2NpY/'^-pj],mo = i{T{p,N)) = max{j : \{2NpY/^-pj] > 1}. When pis 
fixed and ^ 00, we can write RiT{p, N)) = {2Npy/^+0{l), e{r{p, N)) = 
{2N/pf/'^ + 0(1). Finally, for e > (which may depend on A^) define the 
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set T{e,p,N) of "roughly triangular" configurations by 

rie,p,N) = {S : \S\ = N,piS,rip,N)) < eN'^'}. 

Let k = k{N) = max{n : 1+2+- ■ ■+?7, < A^}, and define the configuration 
Tq^ := {k + mi, k — 1 + m2, . . . , 1 + m^), where 

rrii = < — 2 ' 

1^ 0, otherwise. 

Note that \%^\ = N (for example, for = 11 we have %^ = (5, 3, 2, 1)). For 
the particular case p = 1 we say that T{e, 1, A^) is nondegenerate if it contains 
the configuration Tq^ , as well as all the configurations 5* with p{T^ , S) = 1. 
It is easy to see that for any fixed e > there exists A^o = ^o(^) such that 
T{e, 1, A^) is nondegenerate for all A^ > A'q, and the same is true when e.g. 
e ~ AT-", a < 1/2. 

Now we are ready to formulate the main results of this paper. First, we 
state the result about the time to approximate the triangular configuration 
for the deterministic Bulgarian solitaire (i.e., with p = 1). 

Theorem 1.1 Take e > and suppose that N is large enough to guarantee 
that T{e,l,N) is nondegenerate. Suppose that the initial configuration Sq 
with 1 5*0 1 = A^ has the following properties: i{So) < 71 A^^/^ and R{So) < 
72A^^/^ for some 71,72 > 0. Then there exists Vq = fo(£^, 71,72) such that we 
have 

Q^r^SoeTie,l,N) (1.1) 

for all n > VqN^/"^ . 

In words, this result means that if the initial configuration is "reasonable" , 
then the number of moves required to approximate the triangle is 0{N^^'^). 
Now, we turn our attention to random Bulgarian solitaire: 

Theorem 1.2 Suppose that < p < 1. Then for any a < 1/144 there exist 
positive constants Vi = vi{a,p) and 6 = 6{a,p) such that for all N 

7^p,^(T(A^-^p,A^)) >l-exp{~viN'). (1.2) 

In Section El there are some more comments and open problems related 
to the Bulgarian solitaire (both deterministic and random). Also, the reader 
may find it interesting to look at JAVA simulation of the random Bulgarian 
solitaire (with p = 1/2) on the internet page of Kyle Petersen at 
http : //people . brandeis . edu/~tkpeters/ reach/ stuff/ reach] 
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2 Proofs 



This section is organized in the following way. In Section 12.11 we introduce 
the notion of Etienne diagram, which is just another way to represent the 
configurations of the game. Then, we show how the moves of Bulgarian 
solitaire are performed on this diagram and discuss its other properties. In 
Section Em we prove Theorem ll.il and in Section IT^ we prove Theorem 11.21 
(in Section 1231 some results and technique from Sections 12 . 1 1 and l2 . 21 are used, 
most notably the inequality ()2.13|) ). 

2.1 Representation via Etienne diagram and its prop- 
erties 

Before starting the proofs, we need to describe another representation of 
a particular state of (deterministic) Bulgarian solitaire, which we call an 
Etienne diagram (cf. JI]). In this approach the cards are identified with 
particles living in the cells of the set Z = € : ^ > 1, 1 < J < i}, 

with at most one particle per cell. We write TZij = 1 when the cell 
is occupied and TZij = when the cell is empty. Clearly, Z is a half- 
quadrant of Z^, but we would like to visualize Z in a little bit unconventional 
way (see Figure HJ: the cell (1, 1) lies in the base and supports the column 
{(i, 1), i = 1, 2, 3, . . .}, while the diagonal = 1, 2, 3, . . .} goes in the 

NW direction (so the rows of Z are enumerated from right to left; notice that 
at this point we deviate from ^I] , where the rows were enumerated from left 
to right). Now, a configuration S = {ki, . . . , ki(^s)) is represented as follows 
(as on Figure HJ: we put IZij = lZij{S) = 1 for 

ihj) e U |J{(n + m-l,m)}, 

n=l m=l 

and TZij = TZij{S) = for all other pairs From the fact that ki > 

• • • > ^£(5) we immediately deduce that for any S 

if TZij = then TZn,m = for all n > i, j < m < j + n — i, (2.1) 

and 

if TZij = 1 then 7ln,m = 1 for all n < i, max{l, j — i + n}<m<j. (2.2) 
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Figure 1: The Etienne diagram of S = (7, 5, 3, 2, 1, 1). We have 7lij{S) = 1 
for all withz <5 and for (z,j) = (6, 1), (6, 5), (6, 6), (7, 7) 



One of the advantages of the representation via Etienne diagram is that it 
makes it more clear how the process approaches the triangular configuration. 
To see what we mean, first note that the move of the Bulgarian solitaire 
consists in applying the following two substeps to the corresponding Etienne 
diagram (see Figure Ej): 

• apply the cyclic shift (from left to right) to each row of the diagram; 

• if after the shift there is a particle that is placed above an empty cell, 
then the particle falls there; this procedure is repeated until no further 
fall is possible. 

Speaking formally, let S" = QiS. Then the Etienne diagram of S' is con- 
structed using the following procedure: 

(I): For all i put 6°^ = 7lij-^.i{S) for j < i and 6°^ = 7^i,i(5'). 

(II): Suppose that for the array 6° we can find {io,jo) such that b^^^j^ = 0, 
&° = 1. Then construct the new array by bj^j^ = 1, fc-^+ijo = 0, 
and bjj = 6°^- for (i, j) ^ (zq, jo), (^^o + 1, Jo)- 
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Figure 2: Moves of Bulgarian solitaire on the Etienne diagram 



(Ill): Repeat the previous procedure with instead of 6°, and so on. At 

some moment we will obtain an array b"^ for which we cannot find 



(^m, jm) such that bflj^ = 0, bf^^^j^ = 1. Then for all e Z put 



Now, suppose that \S\ = 1 + 2 + ■ ■ ■ + k. On the Etienne diagram the 
triangular configuration corresponds to the configuration {TZi,j = l{i < k}). 
Note also that if the first m rows of the diagram are occupied, then they will 
remain occupied during all the subsequent evolution. This shows that the 
falls of particles "help" to reach the stable configuration (more and more rows 
become all occupied). Moreover, in many concrete situations it is possible to 
know how many moves are needed to fill out some region which was originally 
empty. Arguments of this kind will be heavily used in the course of the proof 
of our results. 

Consider the Etienne diagram of a configuration S. Since the system is 
conservative, there is a natural correspondence between particles (holes) in 
that diagram and particles (holes) in the diagram of the configuration QiS. 
This shows that for each particle (hole) on the original diagram we can define 
its trajectory, i.e., we know its position after n moves of the game. Let Ji,j{n) 
be the second coordinate of the particle (hole) from (i, j) after n moves, and 
let M.ij{n) be the number of falls (movements upwards) that the particle 
(hole) from (i, j) was subjected to during n moves. That means that, if 
7lij{S) = 1, then (i — J\4ij{n), Jij{n)) are the coordinates of the particle 
from after n moves, while if TZij{S) = 0, then {i + A4ij{n), Ji,j{n)) are 
the coordinates of the hole from (i,j) after n moves. It seems to be very 
difficult to calculate exactly Ji_j{n) and Aiij{n) (except in trivial situations, 
when, e.g., 7lij{S) = 1 and lZiiji{S) = 1 for all i' < i). However, we can 
establish some relation between these quantities by defining first 




In words, {i,jij{n)) would be the position of particle (hole) from at 
time n if we know that Aiij{n) = (the quantities J,Ai,J depend also 
on S, but we do not indicate that in our notations). 
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Lemma 2.1 IfTZij{S) — and n is such that i — ji,j{n) > [n/i\M.ij{n), 
orTZij{S) — 1 and n is such that Ji,j{n) > [n/i\M.ij{n), then 



n 
i J 



Mi An) 



Proof. Suppose for example that TZij{S) — 0. Denote j' = j — M.ij{n). 
Since n is such that i — jj J (n) > [n/i\A4ij{n), wehaye thai Jij{n) < Jij'{n). 
The lemma then follows from the fact that Jij(n) should be somewhere in 
between Jij{n) and Jij/{n). The other case is treated analogously. ■ 
Next, wc define some quantities which concern the geometric structure of 
the representation via Eticnne diagram, and prove some relations between 
them. For N > 1 define 

^iv = max{A;:^^^^<iv}; 

when — > cxD, we have 9n = (2A^)^/^ + 0(1). Using the Etienne representa- 
tion of a configuration S, define 

^-(^) - E E (^1^1-^ + ^)' (2.3) 

i<0\s\ j--ni,j{S)=Q 



i>0\s\ j:nij{S)=l 



and put -^(5*) = E^{S) + E^{S). The quantity £'(5') can be thought of as 
the "energy" of the configuration: the bigger is E{S), the "more distant" 
(not necessarily in the sense of the distance p) is S from Tj^. Denote also 
= {S : \S\ = N,e{S) < aN^/'^,R{S) < PN^/^}. The next lemma 
establishes some elementary properties of the energy E{S). 

Lemma 2.2 (i) There exists a constant 7 = 7(0;, /3) such that for all N 
and all S e Gj^ we have E{S) < -fN^/^. 

(a) For all S it holds that E{QiS) < E{S). Moreover, E{S) - E{QiS) 
is equal to the number of falls of particles during the second substep of 
the move of the Bulgarian solitaire represented by the Etienne diagram 
(i.e., it is equal to m in (111)^. 
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Proof. Define 7i(5') = max{i : there exists j such that TZi j{S) = 1}. From 
(12. 2|) one easily gets that there exists 7' = 7'(q;, /?) such that for all S G G^^ 
we have Ti-iS) < The proof of (i) then reduces to an elementary 

computation (roughly speaking, to compute E{S) we have at worst 0{N) 
terms, each of order 0{N^^'^)). 

As for the proof of (ii), note first that the operation of cyclic shift does 
not change the quantities defined in ()2.3|) - ()2.4|) . Then, it is straightforward 
to see that each particle's fall decreases E by one unit, which concludes the 
proof of the lemma. ■ 

Define 

h+{S) = max{i : there exists j E [i — 9\s\,0\s\] 

such that lZij{S) = 1} — 6\s\i 
h_{S) = 9\s\ — min{i : there exists j such that 7lij{S) = 0}, 

and 

V+{S) = \{{z,j)eZ:z>9\si,n,,,{S) = l}\, 
V^{S) = \{{z,j)eZ:z<9\si,'JZ,,{S) = 0}\ 

(cf. Figure El). In words, 

• h_{S) is the maximal vertical distance between d]\f and the holes be- 
low 9n', 

• hj^{S) is the maximal vertical distance between 6^ and the particles 
above 6n which also lie inside the area indicated by the dashed lines 
on Figure El 

• VI is the total area covered by the holes below 6^; 

• V+ is the total area covered by the particles above 9j\f. 

Similarly to the energy E{S), all those quantities could be used to measure 
the deviation of S from the "almost triangular" configuration Tq^ . Consider 
also the normalized quantities h±{S) = \S\~^^'^h±{S), V±{S) = \S\~^V±{S), 
and E^iS) = E{S) = \S\-^/^E{S). 
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Figure 3: On the definition of tlie quantities V±{S), h±{S) 



Lemma 2.3 For all S G 6*71,72 there exist constants ai,i = 1,...,8 (de- 
pending on 71,72^ such that 

aihl{S) < E^{S) < a2hl{S), (2.5) 

aihliS) < E+{S) < aih+{S), (2.6) 

a5hl{S) < V^S) < aih_{S), (2.7) 

arhliS) < V+{S) < ash+{S). (2.8) 

Proof. It is elementary to obtain tlie inequalities (j2.5p and (j2.7p from (j2.ip . 
Analogously, to obtain (j2.6p and (j2.8j) . one can use (j2.2j) and the fact that 5* G 
G'7^'72 together with the following observation. If TZij{S) = 1 for some i > 
9\s\, then either i — 9\s\ < h+{S) or min{j, i — j} < h+{S). m 

Consider a configuration S such that l^l = A^. By definition of 9n, there 
exists a constant /3 > such that 

0<V+{S) -V-{S) < f3N^/\ (2.9) 
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Also, we will always tacitly assume that V^{S) > (3N^^'^, i.e., we will not 
consider configurations that are "too close" to the triangle. In this case 
there are constants /32 > such that 

A < ^ti:^ < /?2 (2.10) 

(note also that if is a triangular number, then Vj^{S) /V^{S) = 1 for any 
S e Xn). Using (12111), dam), and pTTTHl . we obtain 

E^S) < a,hl{S) < ^V4S) < ^V^S) < ^KiS), 

and, by ()2.6|) . E^{S) < a^h^^S). This shows that there is a constant Ci 
such that h+{S) > CiE{S) for all S G (^7^,72- Analogously, we obtain that 
for some ^2,^3 it holds that h^S) > C2El{S) and h^S) > C^eI^^S). 
By Lemma 12.21 (i) the quantity E is bounded on G'7^',72 , so there is C4 such 
that E]/\S) > C^E^_{S), which implies that h_{S) > C^&iS) for some C5. 
Finally, we use Lemma 12.21 (i) once again to obtain that there exists f3 = 
Pill, 72) such that 



mm{h+{S), h-iS)} > I3E^{S) (2.11) 



when S G 6*7^172 • 



2.2 Proof of Theorem fTTI 

First, the idea is to prove that after 0{N^/'^) moves, the "normalized energy" 
E will decrease by a considerable amount. Consider a configuration 5* with 
\S\ = N. Abbreviate h = [(3E^{S)N^/^\; by fTTTlf . we can find mi,m2 
such that T^Qj^^fim^iS) = and 'TlQ^j^y^^^iS) = 1. Moreover, without loss of 

generality one can suppose that h is divisible by 5. Define also ji = mi+4h/5, 
j2 = — Ah/5, and a = i^rpi- Define two sets f/i, f/2 C 2 by 

Ui = <^{i,J):9N-a'--<i<0N--,rni<j<ji + i-9N + -j, 



U, 



2 



|(«,j) -.On + <9n + a+ -,J2 + ^-0n - -<J < "^2j 
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Figure 4: On the definition of sets Ui, U2 



(see Figure HI). Note tliat from (EH) and (Q it follows that n^^j{S) = for 
all G Ui and lZij{S) = 1 for all G f/2- 

Abbreviate also zq = (^n — h/5, -Jq = 6^ + h/b. Now, the idea is to 
consider the evolution of sets f/i, U2 at times io^? = 0, 1, 2, . . .. First, note 
that Ji^jlkio) = j, for any j and k. Then, each time we make a complete 
turn (i.e., io moves) a particle which was on the level 6^ + h/5 will be 2h/5 
units to the left of its initial position (provided it did not fall). This shows 
that there exists ko < ^N^^'^ such that 

2h 

\[Ji'^j^{koio),Ji'^,m2{hio)] n [mi,ji]\ > — 

(when Ji'^j^{koio) > J I'^^m^ihio) , by [Jij,j2(Mo), </iJ„m2(Mo)] we mean in fact 
[0, Ji'^,m2{koio)] U [Jij,j2(Mo),«o])- Take 73,74 such that 

[is, 74] C ([i»,'„j2(Mo),^i^,m2(Mo)] n [mi, ji]) 

and 74 — ja + 1 = We consider two cases: 
Case 1 : at time fco^o in the set 

there is at least one hole, i.e., TZij{Q'f°^°'^ S) = for at least one {i,j) G U[. 
In this case, by 1)2.11) no particle can be in the set 

U2 = {{hj) ■ i e [zo,io + a], J e [j4 - V5,j4]}, 
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i.e., for all (i, j) G U'^ we have that 7^^J(Qf °*°^^) = 0. Note that afco < /i/5, 
so the "image" of f/2 after turns completely covers t/j- the other hand, 
U'2 must be completely empty, so there should have been a lot of particle 
falls in order to avoid U'2- In what follows we estimate the minimal number 
of falls necessary (and, consequently, we find the minimal amount by which 
the energy E should decrease). Define the set 

U2 = {(^, j) : I e K + d/2,i', + a],j G [u - h/lO,j,]} C f/^. 

For any (i, j) G f/2 there is a unique j' such that Jij'{koio) = j, and, by 
the above observation, G U2, so the cell originally contained a 

particle. To guarantee that that particle is not in U2 at time koio, at least 
one of the following two possibilities must occur: 

• either A^jj/(/co^o) > 

• or Jij/^koio) — Jj,j'(fco^o) > h/10, but in this case, by Lemma 12. ![ 
-M^,/(Mo) > ufe > iH^lW = a/2. 

Denote /iq = hN~^^'^; for the both of the above possibilities, we obtained in 
fact that J^ij'ikQio) > Cik'^N^^'^. Since the number of cells in the set U2 
is at least C2h^N , the number of particle falls until time k^iQ should be at 
least Ci/i2jvi/2 X C2hlN = CiC2hlN^''^. By Lemma O (n), it means that, 
for the Case 1, 

E{Qf'''^S) - E{S) < -CiC2hl. (2.12) 

Case 2 : there are no holes at time /cq^o in the set U[, i.e., 7lij{Q^^°^°^ S) = 1 
for all (i, j) G U[. Using the duality between holes and particles, this case can 
be treated quite analogously to the Case 1. Namely, we note first that the 
"image" of Ui after ko turns completely covers U[. So, in order to escape U[, 
the holes that are "candidates" to be there must make a sufficient number 
of movements in the upwards direction. In the same way as in the Case 1, 
one can work out all the details to obtain that ()2.12p is valid for the Case 2 
as well. 

We continue proving Theorem ll.il By ()2.1H) and ()2.12|) . there exist Ai, A2 
such that 

E{Q^r'^S) - E{S) < -Ai^i°(5), (2.13) 

where ns = \2E~'^{S)N^^'^ (the formula ()2.13|) will play an important role in 
the proof of Theorem ll.2l as well). Consider now the initial configuration Sq G 
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Lemma := -E'(S'o) < F for some T. Fix an arbitrary e > 
and define ip{x) = x — \ix^^; then tliere exists ki (depending only on F, e, Ai) 
sucfi tliat (f^^'^\ao) < e. By fl2.13|) tliis means tliat 

E{Qf'^^S) < e, (2.14) 

wliere n'g = ki\2£^'^ N^^"^ , i.e., after 0{N^^'^) moves we will arrive to a confi- 
guration with small normalized energy E. 

Now we are almost done with the proof of Theorem II. H and it remains 
only to make one small effort: we have to prove that if the energy E{S) is 
small, then either S is already close to the triangular configuration T(l, 15*1) 
(in the sense of the distance p), or it will come close to T(l, \S\) after 0{N^^^) 
moves. 

Define the sets 

V{e,N) = {S -.181 = N,msix{h+{S),h^{S)} <eN^/^}, 
V{e, N) = : \S\ = N, max{i : there exists j such that 

TlijiS) = l}<eN + £iVi/2} n V{e, N). 
It is elementary to see that, for fixed e and for all N large enough 

V{e,N) cr{2e,l,N). (2.15) 

We need the following 

Lemma 2.4 Suppose that S G V{e, N)nG^^^^^, and put uq = [max{7i, 72}] + 
2. ThenQ^^°^''^S eV{2noe,N). 

Proof. Define 

V'{e,N) = {5 : 151 = A^, max{i : there exists j G [l,6'7v] such that 

7^i,i(5) = 1} < + eN'/^} n V{e, N). 

First, if £ < I/V2 and S G V{6,N) n G^^^^^, then the set {{i,j) : i > 
9n + £N^^'^,j G [l,eA^^/^]} will be empty of particles after eN^/'^ moves. By 
examining where those particles could go, we see that Q^f^^S G V{2e,N) 
and that 

max{i : there exists j such that 7lij{S') = 1} — 6n < (£+niax{7i, 72})A^"'^'^^, 

where S' = Q^i^ ^ ''S. To conclude the proof of the Lemma l2.4| note the 
following two facts: 
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• Suppose that at some moment the configuration belongs to the set 
V{e', N). Then if i' > 9^ + e'N'^/^ and there are some particles in the 
set {{i-ij) '■ i ^ = i'}, then at the next moment all those particles 
will fall one unit. 

• If ^ G V{e',N) and 

max a - mini J : 7^i ,(5) = 1}) < e"iV^/^ 

then S e V'{e' + e", N) (to see this, it is enough to figure 

out what happens with the configuration S" after 9^ + e'N^^"^ moves, 
where S" is defined by TZij{S") = 1 whenever either i < 9^ + e'N^^'^ 
OT i-j < e"N^/'^). 

■ 

Now we are ready to finish the proof of Theorem 11.11 From ()2.5|) . ()2.6|) . 
and (j2.14j) we obtain that, if the initial configuration belongs to G^^^^, 
then after 0(A^^/^) moves it will be in V{e',N) n where e' = 

^1/3^ j-i^jj-^|Q,i/3^ ^i/3| .g fj^Qj^ (|2.14j) . ai,a3 from Lemma l2.3p . Applying 
Lemma 12.41 we conclude the proof of Theorem 11.11 ■ 

2.3 Proof of Theorem [O] 

Consider a finite irreducible discrete-time Markov chain with state space X, 
transition matrix P, and stationary measure tt. The following elementary 
fact will be useful in the course of the proof of Theorem 11.21 for any A G X 
and n > 1 

yeA" y^A" 

Let us describe the main steps of the proof of Theorem 11.21 

• first, in Lemma [2.51 we prove (using ()2.16|l ) that a typical configuration 
of the random game should be reasonable, i.e., the number of piles and 
the biggest pile should be 0{N^^'^); 

• then, the idea is the following: starting from a reasonable configuration, 
the macroscopic evolution of the profiles will be very similar in the 
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random game and in the deterministic game where the initial sizes of 
the piles are times bigger (indeed, if the initial size of the pile in 
the random game is k = 0{N^^'^), then it will be emptied typically in 
time fc/p±0(ArV4)); 

• unfortunately, it seems to be difficult to dominate the stochastic game 
by the deterministic one directly. So, we introduce another determin- 
istic process by allowing the immigration of particles to the system on 
each step. In Lemma f2. 61 we prove that the random Bulgarian solitaire 
is in some sense dominated by this new deterministic process; 

• it is then possible to see that the process with immigration of parti- 
cles does not differ much (when the time interval in question is not 
too long) from the deterministic Bulgarian solitaire, because the total 
number of added particles is relatively small, and they cannot be very 
concentrated fLemma l2.7l takes care of the latter statement). Using this 
observation and applying inequality (j2.13p from the previous section, 
we obtain that the (suitably defined) energy will decrease with large 
probability after a sufficiently large number of steps (this is Lemma lTB]) : 

• the rest of the proof is a straightforward (although somewhat lengthy) 
application of ()2.16|) and Lemma ITHl 

So, the first step is to prove that a typical configuration S E Xn should 
be "reasonable", i.e., it should belong to Gy for some 71,72: 

Lemma 2.5 (i) For any p G (0, 1) there exist positive constants (70,7^,72 
(depending on p) such that 

%,iv(G^|,,,) > 1 - e--^^^l (2.17) 

for all N. 

(a) Also, suppose that S G Gy where 7^,72 are the quantities from 
item (i). Then there exist 71,72 and cxi such that for any M > 1 

P[Qi")5 G ^,,] > 1 - iV^^^e-'^i^'''. 

Proof. We begin by proving (i). Consider the sets 

Aj^ = {S -.131 = N,i{S)>3N^/yp} 
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A'^ = {S:\S\=N4{S)>hN^'^/p]. 

Note that if ^ = (fci, . . . , k^^s)) e An, then \{i:ki> pN^/'^}\ < N^'^/p, i.e., 
in S there are at most N^/"^ /p piles with at least pN^^"^ cards. Clearly, if a 
pile had no more than pN^^"^ cards, then there is Ci > such that by the 
time 3A^^/^/2 that pile will be empty with probability at least 1 — e~'"^^^^'^ . 
During the time 3N^^'^/2 only 3iV^/^/2 new piles can appear, so, since l/p + 
3/2 < 3/p, for any 5* G we have that, 

P[g(3^'''/2)5 eXN\AN]>l- iVe-^^^''^ (2.18) 

Since A'^ C An, ()2.18p also shows that for any S E An \ A'n we have 

P[Q?^'^'^^^5 G A'j^] < Ne~^'^"\ On the other hand, if 5 G Xjv \ An, then 

clearly ^[Qf^^'^'^'^S G A'n] = 0, so (since 3/2 < 2/p) for any S G X^v \ ^'^v 
we have 

p[g(3ivVV2)^ G A'^] < iVe-^^^'''. (2.19) 

Now we use flTTHIl with A = A'j^ and n = 3iVi/V2 to obtain from ^TW) 
and ^rn^ that for some C2 > 

TTp^Ni^N \ A'n) = TTp^NiS : i{S) < hN"^/p) > 1 - e-^^^''l (2.20) 
For A; = 1, ... , [N^/^\ define 

= {5 : \S\ = N,{k- l)pN^'^ < R{S) < kpN'/^} n {Xn \ A'j^). 
Suppose that 5 G -B^'' for some k > 1 + ^ + ^) and let us try to figure out 

C3^i/2 

what the configuration Qp S should look like. Note that 

• i{S) < and moreover £(Qi'"^5) < (^ + f )iV^/^ for all m < ^N^/^ 
so, since (k — l)p > ^ + |, no new pile of size greater than {k — l)pN^/'^ 
can appear until the moment |A^^/^; 

• the evolution of a single pile can be modeled by a random walk on Z+ 
which jumps one unit to the left with probability p and holds its position 
with probability 1 — p. This shows that if the size of the pile was less 
than kpN^/"^, then after |A^^/^ moves it will be less than {k — l)pN^/'^ 
with probability at least 1 — e~'~^^^^''^ for some C3 > 0. 
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From the above facts we deduce that for any S G -B^^ 



as long asA;>l + ^ + ^. Now using with A = sJJ^ and n = 3N'^/'^/2, 

we obtain that for some C4 > 



,(m)N 



m>k 



SO by induction one can show that 7rp^7v(-B/^'*) < C^N'^e 



. Summing 



over ^ > 1 + ^ + ^ and recaUing ()2.2()|1 . we conclude the proof of the part (i) 



72 



5 I 3^ 



of Lemma 12.51 (with 7^ = 

To prove the part (ii), first observe that in the proof of (i) we have con- 
structed 7^, 72 in such a way that for any S G Gy 



P[Qr'^^/^)^GX^\G5j<e 



_CAri/2 



2' 72 



To complete the proof of (ii), it is enough to take 7" = li + 
max{7^, 72} + I (note that for any S we have i{QpS) — i{S) < 1, R{QpS) < 
max{R{S),i{S)}). m 

We continue proving Theorem 11.21 Now, the main idea is the following: 
first, to dominate the random Bulgarian solitaire by a certain deterministic 
process (that we will call Bulgarian solitaire with immigration of particles), 
and then apply to that process some methods from the proof of Theorem ll.il 

Fix 60 G (0, 1 — 36a), and abbreviate K^r = [iV''°"'"4]. Denote also Np : = 
[N/p]. For any S, let us define configurations D{S),D{S) in the following 
way: if S" = (ni, . . . ,^£(5)), let 



D(5) 



ni 

P 

ni 

P 



Zi,... 

Zi + Kn, 



P 



P 



where Zi = Zi{S) G {0, 1} are chosen in such a way that Zi > Z2 > ■ ■ ■ > Zi(s) 
and for any S G Xn we have |2!)(5')| = Np. Define the operator Q by 



QS = ord(?2i - 1, ... , ne(s) - 1, ^(•S') + kn), 
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i.e., making the Q-move consists of making a move of deterministic Bulgarian 
solitaire, and then adding cards to the new pile (so that \QS\ — \S\ = k^)- 
For the simplicity of notations, we do not indicate in Q the dependence on 
and 60] note also that in the above display we do not assume that 15*1 = N, 
so Q need not apply to only S E Xn- 

For two configurations Si = (ni, . . . , n^(5^)), S2 = {mi, . . . , ^^(52)) we say 
that Si < S2 if i{Si) < £{S2) and rij < mj for all j = 1, . . . , i{Si). 

Lemma 2.6 Suppose that \S\ = N and S G y (where 7i,72 are the 
quantities from Lemma \2.5\) . Then for any M > there exists 02 such that 

P[g(")S(5) > D(QJ,"^5) for all n < N^^] > 1 - A^A^g-'^^*". (2.21) 

Proof. Let us refer to the £{S) piles of S and D{S) as Vi, . . . ,Vi(^s) and 
Pi, ... , Ve(^s) respectively. Then, the piles born at the moment i are referred 
to as Vi(s)+i and Vi[s)+i- Using the notation (x)"*" := max{x,0}, for n > 
{i — i{S))^, let Vi{n) and Vi{n) stand for the sizes of the piles Vi and Vi 
at the moment n, respectively (if a pile is emptied at some moment n* < n, 
then we mean that the size remains for all m > n*). 
Clearly, the event 

N^'+e{s) 

{Q(")I)(5) > ^(Q^p^S) for all n < N^^} C p| A^, (2.22) 

i=l 

where we define the event Aj by 

A- = {Vi{n) < pViin) for all n>{i- 1{S))+}. 

Define also the event D = {Q^f^^ S G Gy, y,}; by Lemma 12.51 (ii) we know 
that P[D]>1- N^'e-''^^^'\ On the other hand, 

P[A, I Ai, . . . , A,_i, D] > P[i/.]P[A, I H,, D], (2.23) 

where Hi = {pVi{{i - £(5))+) > Vi{{i - i{S))+) + kn/2}. Now, on D we 
have that £(qJ,"^^) = 0{N^/^) for all n < N^^ , and on Ai n . . . n Ai_i it 
holds that ^(Q(")2)(5)) > iiQ^^^S). Using the Large Deviation bound for 
the Binomial distribution, we see that the first term in the right-hand side 
of (j2.23p is at least 1 — 6"*"^^ ° . As for the second term, note that the 
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difference between pVi{-) and 'Pj(-) is a random walk with drift 0. Since 
the time that the pile Vi needs to be emptied is 0(A^^/^), the second term 
in ()2.23|) is in fact the probability that such a random walk does not deviate 
from its initial position by more than by time 0(A^^/^); clearly, that 

probability is bounded from below by 1 — e~^'^^ ° . Then, it is immediate to 
deduce Lemma ESI from (IZ^ and (IZ^ . ■ 

Recall that (cf. the proof of Lemma \2.2\\ for any configuration S we use 
the notation 

7Y(S') = max{i : there exists j such that 7lij{S) = 1}. 



Lemma 2.7 Suppose that S G Gy y and let (3 he such that (3 < \ — 5q. 
Then there exists Lq such that n{Q^''^T){S)) < LqN^^^ for all n < N^+K 

Proof. Let 6o = and denote = 6o(&o + l)/2- Define the triangular 

configuration % by 7lij{%) = l{i < bo}; then, clearly, D{S) < %. Denote 
bi = bo + \k,n/V2], bi = bi{bi + l)/2 and define the configuration 71 by 
TZi jCTi) = l{i < bi}. By examining the Q-evolution of % on the Etienne 
diagram, it is clear that Q ^ < for all n < bo. We then repeat this 
construction by defining bm+i = bm + \kn/V2], bm+i = &m+i(&m+i + l)/2 
and the configuration %n+i by 7lij{Tm+i) = < fem+i}- Analogously, we 
obtain that Q^"'''%n < %n+i for all n < 6„. A simple monotonicity argument 
then shows that Q^"'^'I){S) < %a+i for all n < bo + ■ ■ ■ + b„i. We have 
bo + - ■ ■ + bn, > (m+l)6o and bo < CiN^^^ for some Ci, so Q(")l)(5) < t^-i^^! 
for all n < A^^/^+z^. So, since | + 5o + /3 < |, for some Lq we have 



V2 

for all A^, thus concluding the proof of Lemma 12.71 ■ 

Lemma 2.8 Fix some a G (0,1/16) and suppose that a configuration S G 
^tI 72 ^'^ ^^^^ ^^^^ ^i'^i^)) — -^sA^"" fof^ some A3. Then, with \i, \2 
from i2.1!^) . we have for some o"3, 5i > 

P[E(S)(qJ,"'«^5)) - E{^{S)) < -Ai^i°(D(5))/2] > 1 - e^-^^^'S (2.24) 

where n'g = X2E^'^(D(S))N^^'^ /p. Moreover, \2. 24^ remains true when Q^^^ 
is substituted by for any n G [n'g, 2n'g\. 



1/2 
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Proof. First, each particle added to T){S) changes the energy E by at 
most 0(A^^/^), so we have for some constants Ci,C2 

\E{t){S)) - E{^{S))\ < e{^{S)) X CiN^/\n < C2N^/'^+^°. (2.25) 

Using the same sort of argument and the fact that Q^'^^S' > Q^^^ S" for any 
m, S' > S", with the help of Lemma [2.71 and (j2.25j) we obtain 

\E{Q^fi^^{S)) - E(Q("'s)l)(5))| < CaAT^/^+'^o + C3nsN^^^+^°. (2.26) 

Introduce the event = {Q('^s)S)(^) > ^{Q^f'^S)}. By Lemma ITTIl we 
have 

P[Di] > 1 -n'^e-"^^'", (2.27) 

and, since 

|qK)2)(5)| - \^{Qi'''^S)\ < {0{N'/') + n's)K^, 
analogously to (j2.25p - (j2.26p we obtain that on Di 

|E(g("s)l)(S)) - E(D(gi"'«^5))| < C4nsN-^+^°. (2.28) 

Now, we have that E^°{D{S)) > XfN-^^'^, and n'siVt+'^« < C5N^+^'^+^'' . 
Since | - 10a > f + 2S + 5o, we obtain the proof of ^TI^i from ^IT^ . ^TI^ . 
(ITTfll . and (EH- 

As for the second claim of Lemma 12.81 we note that for n > n'g, by 

Lemma 0(ii) it holds that E{Q^^^T){S)) < E{Qf'''^^{S)), and then use 
the same kind of estimates as used above. ■ 

Now we are ready to finish the proof of Theorem 11.21 By Lemma 12.51 
(i) there are ctq, 7^,72 such that ()2.17|) holds. Note that there exists F' = 
F'(7;,7^) such that if 5 G G^,^^y^, then E{^{S)) < T'. Define ^{x) = x- 

iAiX-i°. Let yo = T' and yi+i = ip{yi) for i > 0. Take e = A^"", a < 1/144, 
and define i = minjai, asje^ (cf. (j2.5p and (|2.6p ). Let n = min{n : ?/„ < i}; 
since i = 0{N^^^^), by examining the iteration scheme x 1— >■ ijj{x) we obtain 
that there exists Ci such that n < CiN^^"^^. Let 

Cn = {Se G^l,^, : E{S{S)) e (y„+i,2/„]}. 
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and define also = [J C-k, >C<„ = \^ Ck- Take any n < n and denote 

k>n k<n 

mn = \2ynliN^'^IP- By flTTH|) and Lemma 123] (i) we can write 

E ^MSi)Pts} = E ^^-^(^2)4:5,^ (2.29) 



< e-"°^'^' + Ti + Ta, (2.30) 



where 



Si aCn 

S'2e£>n 



T2 = Yl ^P.^(^2)Pf"^ 



S2SI ■ 



Now, by Lemma [2.81 the left-hand side of ()2.29|) can be bounded from below 
as follows: 



Sl&Cn Sl&Cn S2&C^ 



(rrin) 
S1S2 



> 7r,,A,(/:„)(l-e-'^«^'^). (2.31) 
Again using Lemma f2. 81 we write 

Ti< E vrp,^('^2)e-"^^'' < e-"^^'\ (2.32) 

Using now ()2.31|) and ()2.32p together with the trivial bound T2 < vTp^Ar (£<„), 
we obtain from (jT^ - (jT!?n|l that for some C2 > 

rcM^n) < C2 (^e-^oN^^' + e—^""'' + E ^vA^k)) ■ (2.33) 

k<n 

By induction, we then obtain that there is C3 > such that for any n < n 

vrp,^(/:n) < Csn^e-'^^^'S (2.34) 
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so, since n < CiA^^^^^, taking summation in (|2.34j) we obtain for some C4 > 
that 

TTp^NiS G : ECDiS)) > e) < C^N^'''^^e-''^'''\ (2.35) 

Now, the last step of the proof of Theorem 11.21 is analogous to what was 
done in Lemma ITU Note that if £'(D(S')) < e, then 

max{/i_(D(5)),/i+(D(5))}< {—^ 1)'^' = ^' 

so if < e, then G V(e, thus showing that 

7rp,iv(5 G : G V(£, A^p)) > 1 - C^N^^'^^e-"'^'" . (2.36) 

Define 

i/o = {5:S)(5) gV(£,|D(^) I), max{i: there exists J <e|D(^) 1^/2 

such that 7^i,J•(S)(5)) = 1} > + 2e|S)(^)|^/^}. 

Take any S G G:^^^^,, and denote W = {S e Xn : S)(^) G V(e,A/p)} (recall 
that \D{S)\ = Np). Using (IZTT)D . we write 



E ^ = E ^p.^(^2)PS:'' ^ (2.37) 

n + T^, (2.38) 



where 



S2S1 ' 



^2 = E ^P,^('^2)^525i 



Observe that if D{S) G V{e,Np) and e is small enough, then after 2eNp^'^ 

-1 /o 

moves there will be no particles in the set ■ i > On„ + 2eNp },j < 
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eNp^'^ , with probability at least 1 — e '^^^^^^ for some C5. So, for the left-hand 
side of ()2.37|) we can write 

E -^pAsMlsf^^ > 7rMHo)a - e-^^^^'^). (2.39) 

Si&Ho 

On the other hand, the same argument implies that T{ < e~^^-^^^^ and the 
bound T2 < T!'p,NpiW'^) is trivial. So, using (j2.35p and (j2.39p . we obtain 
from ^rfi^i that 

vrp,jv(i/o) < C6iVi'/''e-'^3^'\ (2.40) 
Abbreviate H = Hq fl W and define 

-Ffc = {S : S)(S') G -ff, max{i : there exists j > On^ such that 

7^,,,(S)(5)) = 1} - - sN^/^ e {2ekN^/\ 2e{k + l)N^'^]], 

F<fc = y Ffc, F>fc = y Ffc. Analogously to (IZ^ - dmilD and TH^ - TH^ . 

m<k m>k 

we write 

E = E (2.41) 

Ti" + T2 + T3 , (2.42) 



where 



Si&Fk 



The following fact can be deduced from (Q: if D(^) G and TZij{^{S)) 
+ leNp^\ then i- j < eNp 



f~ 1 /2 1/2 

1 for some i > 6^ + ^eNp , then i — j < eNp . Then, by examining 
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the evolution of S)(S') on the Etienne diagram and using Lemma \'2.b\ it is 
elementary to obtain that for any S & Fj^, k > 1 

P[D(gf ^ F, U F>,] > 1 - e-''^'^''^ 

Using that fact, one can bound the left-hand side of ()2.4ip from below 
by 7rp_7v(-^fc)(l — e~'^''^^^'^) and the term T2 can be bounded from above 
by e~*^^^^ ^. Then, it is straightforward to write T" < J2m>k'^p,N{Fm), 

< t^p,n{H''). Denoting now m = = ^, analogously to (j23Sl)-(EISl 

we obtain 

TTpAFk) < Csim - A;)2iVi5/24e-3Jv^i . (2.43) 

Summing over k = 1, . . . , m and taking ()2.36|) and ()2.40|) into account, we 
finally obtain that for some Cg, 5 > (depending on a) 

7rp,;v(V(3£,iVp))>l-e-^^^'. 

Since e = A^~" and a < 1/144 is arbitrary, we complete the proof of Theo- 
rem O (note that D-\V{e,Np)) c T{2e,p,N) for e > N-^/^). m 



3 Final remarks 

A natural question that one may ask is: starting from an initial configu- 
ration S with i{S) = 0(iVi/2),i?(^) = 0{N^/'^), how many steps (of the 
deterministic game) are necessary to reach T{e{N),l, N) where e{N) 
as 00. From the proof of Theorem 11.11 it can be deduced that if 

e{N) ~ iV"", < a < 1/2, then 0{N^+^^°') moves suffice. However, this 
result is only nontrivial when a < 1/72 (since 0{N) moves are always enough 
to reach the "exact" triangle), and even then it is almost certainly far from 
being precise. 

Also, loosely speaking. Theorem 11.21 shows that the typical deviation from 
the triangle is of order at most 0(A^2~i«). Again, we do not believe that 
that result is the best possible one. In fact, the author has strong reasons 
to conjecture that the typical deviation should be of order A^4; however, the 
proof of that is still beyond our reach. 
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